Prom Toeplitz Eigenvalues through Green's Kernels to 
Higher-Order Wirtinger-Sobolev Inequalities 



A. Bottcher and H. Widom 

The paper is concerned with a sequence of constants which appear in several problems. These 
problems include the minimal eigenvalue of certain positive definite Toeplitz matrices, the minimal 
eigenvalue of some higher-order ordinary differential operators, the norm of the Green kernels of 
these operators, the best constant in a Wirtinger-Sobolev inequality, and the conditioning of a 
special least squares problem. The main result of the paper gives the asymptotics of this sequence. 



1 Introduction and main result 

There is a sequence 01,02,03, .. . of positive real numbers that emerges in various contexts. 
Here are five of them. 

Minimal eigenvalues of Toeplitz matrices. Given a continuous function a on the complex 
unit circle T, we denote by {ak}^^_ao the sequence of the Fourier coefficients, 

^TT Jo 

and by Tn{a) the nxn Toeplitz matrix (aj-fc)jfc=i- Suppose a is of the form a (t) = 
{t £ T) where a is a natural number and 5 is a positive function on T whose Fourier coefficients 
are subject to the condition J2T=-oo 1^1 l^fcl < 00. Then the matrix r„(a) is positive definite 
and its smallest eigenvalue Xmm{Tn{a)) satisfies 

Amin(7^«(o)) ~ ^6(1) as n^oo (1) 

with a certain constant Oq. G (0, 00) independent of b. Here and in what follows Xn ~ Un means 
that Xn/Un — *■ 1- Kac, Murdock, and Szego 8_ proved that ci = vr^, and Parter showed 
that 02 = 500.5467. 

Minimal eigenvalues of differential operators. For a natural number a, consider the 
boundary value problem 

(-l)°n(2")(x) =f(2;) for xG[0,1], (2) 
-u(O) =n'(0) = ... = n("-i)(0) =0, = n'(l) = . . . = n("~^)(l) = 0. (3) 

The minimal eigenvalue of this boundary value problem can be shown to be just Cq,. If a = 3, 
then the equation — w^^^ = Xu is satisfied by 



""(2^) = ^'^k exp (^x VX exp ^ (^^ + ^)^^ ^^ 
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and the A^'s are the solution of a homogeneous hnear 6x6 system with a matrix depending 
on A. We found numericahy that the smallest A > for which the determinant of this matrix 
is zero is approximately A = 61529. Thus, C3 = 61529. 

Norms of Green's kernels. Let Ga{x,y) be the Green kernel of problem @, ©• The 
solution to 0, (El) is then given by 

u{x)=( Ga{x,y)v{y)dy. (4) 





It can be shown that Ga{x,y) is symmetric about the point (|, ^) and that 

for X + y > 1. Let Ka denote the integral operator defined by @. It is clear that the minimal 
eigenvalue of , © equals the inverse of the maximal eigenvalue of the (compact and positive 
definite) operator on -L^(0, 1). As the maximal eigenvalue of Ka is its norm, we arrive at 
the equality 1/cq, = ||-K^a||- 

Best constants in Wirtinger-Sobolev inequalities. By a Wirtinger-Sobolev inequality 
one means an inequality of the form 

1 j-i 
u{x)\'^dx < C / (6) 







where u is required to satisfy certain additional (for example, boundary) conditions. It is well 
known that the best constant C for which © is true for all u E C"[0, 1] satisfying u{x)dx = 
and u(j)(0) = u^^\l) for < j < a - I is equal to l/(27r)2°. However, problem 0, © leads 
to © with the additional constraints (j3)). In this case the best constant in ® is C = 1/cq. 

Conditioning of a least squares problem. Suppose we are given n complex numbers 
j/i, . . . , y„ and we want to know whether there exists a polynomial p of degree at most a — 1 
such that p{j) = yj for 1 < j < n. Such a polynomial exists if and only if 



a \ /a 



Sk ■■= yk - i^-^^ j yk+i + 2 j ^^'^'^ - ■■■ + i-'^Tvk+a = (7) 

for 1 < k < n — a. Thus, to test the existence of p we may compute 

^1/2 

D{yi, . . . ,yn) 

and ask whether this is a small number. Let Va denote the set of all polynomials of degree at 
most a — I and put 

, 1/2 

E{yi, . . . ,y„) = mill V \yj -p(i)p 
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The question is whether E{yi,...,y„) may be large although D{yi, . . . ,yn) is small. The 
answer to this question is (unfortunately) in the affirmative and is in precise form given by the 
formula 



max 



E{yi 



n 



D{yu...,y^)f^O D{yi, ...,yn) 

Here is our main result on the constants Cq, we have encountered in the five problems. 
Theorem. We have the asymptotics 



(8) 



2a 



a 



as a 



oo 



(9) 



and the bounds 



4a -2 (4a)![a!]^ 4a + 1 (4a)![a!]^ 

- - 2^TT [(2a)!]2 



4a2_a [(2a)!]2 
In connection with HlOj) . notice that 



for every a > 1. 



(10) 



(4a)! [a 
1(2^ 



112 



112 



V8 



4a 



Thus, the upper bound in (fTU)) is asymptotically exact, while the lower bound in (jTU]) is 
asymptotically by the factor l/(2a) too small. This last defect is nasty, but on the other hand 
it is clear that l/(2a) is nothing in comparison with the astronomical growth of (4a/e)2". 

We discuss the five problems quoted here in more detail in Section |2 The theorem will 
be proved in Section 1^1 Section 0] is devoted to an alternative approach to Wirtinger-Sobolev 
inequalities and gives a new proof of the coincidence of the constants in all the five problems. 



2 Equivalence and history of the five problems 

Toeplitz eigenvalues. For a = 1, formula goes back to Kac, Murdock, Szego [H]. In the 
late 1950's, Seymour Parter and the second of the authors started tackling the general case, 
with Parter embarking on the Toeplitz case and the second of us on the Wiener-Hopf case. In 
[TT] (a = 2) and then in ^01 , (general a), Parter established 

Subsequently, it turned out that the approach developed in ^^l, ^Bj; can also be used to 
derive (0). This approach is as follows. Let [T~^{a)]j^k be the j, k entry of T~^{a) := (T„(a))~-^ 
and consider the functions 

n[T~\a)]inxUny], (x,y)e[0,l]^ (11) 

where [nz] is the smallest integer in {1, . . . ,n} that is greater than or equal to nz. Let ET^"^ 
denote the integral operator on L2(0, 1) with the kernel (|1H) . One can prove two things. First, 

as n ^ oo, (12) 



n 



L K^n) _ J_ 
2« 6(1) 
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where Va is an integral operator with a certain completely identified kernel Fa{x,y). And 
secondly, the eigenvalues of K^'^^ are just the eigenvalues of T~^{a). These two insights imply 
that 111 1 



A^in(T„(a)) n^^ ^'^^^^^ ^ 6(1 
or equivalently, 

Amin(T„(a)) ^ 6(1). 

The kernel Fa{x,y) is quite complicated, but it resembles the kernel Ga{x,y) given by ©. 

Green's kernel. In [1D| and J^] it was further established that Fa{x,y) is the Green kernel 
for the boundary problem @, ©• This implies at once that actually Fa{x,y) = Ga{x,y) and 
Va = Kct- Thus, at this point is clear that in the first three problems of the introduction we 
have to deal with one and the same constant Cq,. 

Expression © was found in Tj. That paper concentrates on the case where 6=1, that 
is, where a{t) = |1 — ip" (t G T). Using a formula by Duduchava and Roch for the inverse of 
r„(|l - it is shown in a direct way that 



[7^n'(|l-i|'")]M,[n,]-G„(x,y) in L-([0,1]^ 



Moreover, ^ has a short, self-contained, and elementary proof of the fact that Ga{x,y) is the 
Green kernel of ((2)), ©. 

Rambour and Seghier 113] showed that 

ni-2-[r-i(|l-tp"6(t))]M,[n,]-^G,(x,y) in L~([0,l]2) (13) 

under the assumptions on 6 made in the introduction. Evidently, (|13|) implies ()12l) (but not 
vice versa). For a = 1, result H13|l was known from previous work of Courant, Friedrichs, and 
Lewy 15 and Spitzer and Stone Jl]. The authors of ^Sl were obviously not aware of papers 
[TU] and ^S] and rediscovered again that Gaix,y) is Green's kernel of ©, ©. 

Wirtinger-Sobolev. The connection between the minimal eigenvalue of ((2j, (j31) and the best 
constant in © with the boundary conditions © is nearly obvious. Indeed, we have 

((_l)a^(2a)^^) 

Cn = min - 



(n,n) 

where (•, •) is the inner product in L^(0, 1) and the minimum is over all nonzero and smooth 
functions u satisfying ©. Upon a times partially integrating and using the boundary condi- 
tions, one gets 

(u('^),u(")) /f! |uM(x)|2dx 

Ca = mm — r — = mm , 

{u,u) jQ\u{x)\^dx 

which is equivalent to saying that the best constant C in (jB)) with the boundary conditions (jH)) 
is C = I/cq. 
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Numerous versions of inequalities of the Wirtinger-Sobolev type have been established for 
many decades. The original inequality says that 



\u{x)\'^dx 











u{x)dx 
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whenever u G C^[0, 1] and ti(0) = u{\). This inequality appears in different modifications, 
sometimes with the additional requirement that u{x)dx = and frequently over the interval 
(0,27r), in which case the constant l/(27r)^ becomes 1 (see, e.g., jBj pp. 184-187]). The proof 
of (|14() is in fact very simple: take the Fourier expansion u{x) = Yl, u^^e^'^^^^ and use Parseval's 
equality. We will say more on this topic in Section |2 which contains a direct proof of the fact 
that the best constant C in @ with the boundary conditions © is the inverse of the constant 
Co of (UJ). 

The least squares problem. The least squares result is from Pj. Define the linear operator 
V : C" ^ C" by V(yi, . . . , y„) = (5i, . . . , 5n-a, 0, . . . , 0), where the 4's are given by 0, put 
KerV := {y € C" : Vy = 0}, and denote by -PxerV the orthogonal projection of C" onto 
KerV. The left-hand side of (jSJ is nothing but 

||y - i^KcrVylb /-rc-N 
max ,, , (15) 

S/^KcrV ||Vy||2 

where || • ||2 is the l"^ norm on C". With denoting the Moore-Penrose inverse of V, we have 
the equality / — -PxerV = V+V. This shows that (jlSj) is the norm of V"*", that is, the inverse 
of the smallest nonzero singular value of V. But VV* can be shown to be of the form 

T„_„(|l-tP") \ 
\ j 

where J is a permutation matrix and Oa is the ax a zero matrix. Thus, the smallest nonzero 
singular value of V is the square root of Amin(T'n-o(|l — tp")) ~ Ca/n^", which brings us back 
to the beginning. 

A wrong conjecture. The first three values of Cq are 

ci = vr^ = 9.8696, C2 = 500.5467, C3 = 61529, 

and the first three values of((a-|-l)7r/2)^" are 

vr^ = 9.8696, 493.1335, 61529. 

We all know that one should not guess the asymptotics of a sequence from its first three terms. 
But because of the amazing coincidence in the case a = 3, it is indeed tempting to conjecture 
that Cq, ~ ((a-|- l)7r/2)^°. Our main result shows that this conjecture is wrong. The first three 
values of the correct asymptotics Cq, ~ \/87ra (4a/e)^° are 

10.8555, 531.8840, 64269. 
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3 Proof of the main result 



We employ the equality I/cq = ||i^a||, where Ka is the integral operator on L^(0, 1) with 
kernel 

The kernel's peak. It will turn out that the main contribution to the kernel Ga{x,y) comes 

'I 1^ 

operator on L^(— 1, 1) whose kernel is 



from a neighborhood of (5,5), and so for later convenience we consider instead the integral 



The operator Ka has the same norm as Ka, its kernel is symmetric about (0, 0), and the main 
contribution to the kernel comes from a neighborhood of (0,0). If we make the substitution 
t — > (1 + t)/2 in the integral we see that 

with 

Ha{x,y) = {l + xni + yr (n^A/J<! (1^) 

Jraa.x(x,y) {{^ T Tj/Zj 

when x + y > 0. We shall show that Ha{x, y) is equal to (l/a)(l — x^)"(l — y^)" plus a kernel 
whose norm is smaller by a factor 0{l/y/a). 

The logarithmic derivative in t of the function {t — x) {t — y)/((l + 1)/2)'^ is 

(2 + X + y)t — X — y — 2xy 
{l+t){t-x){t-y) ' 

which is positive for t > max{x,y). (Recall that we are in the case x + y > 0.) Hence 
the function achieves its maximum (1 — x)(l — y) at t = 1 and nowhere else. The function 
(1 + x)(l + y)(l — a;)(l — y) achieves its maximum at x = 0, y = and nowhere else. Putting 
these together we see that the function 

achieves its maximum 1 at t = 1, a; = 0, y = 0, and outside a neighborhood of this point, say 
outside the set t > 1 — £, \x\ < e, \y\ < e, there is a bound 

for some 6 > 0. It follows that outside the same neighborhood the integrand in (|16|) with its 
outside factor is 0((1 — 5)"). This is also the bound after we integrate. We take any e < 1/2, 
and have shown that 

Ha{x, y) = (1 + xni + yrxe{x)xe{y) "((! +'/)/2")2^r'' + ^((1 - 
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where Xe is 1 on [— e, e] and zero elsewhere. Substituting t = 1 — r we arrive at the formula 



H^{x,y) = {l + xr{l + yrxe{x)Xe{y) 

dT 



T\2 



+o{{i-6r). 



(17) 



The kernel's asymptotics. Let us compute the asymptotics of the kernel. The choice 
e < 1/2 guarantees that r/(l — x), r/(l — y), t/2 belong to (0, 1). This implies that 



—T(p{x,y)+0{T-^) 



with 



(1-5)' 



1 — xy 



(l-x)(l-y)- 



We split the integral in (fT7|) into /g and Si/^- If £ > is small enough, which we may 
assume, the term O(r^) is at most TLp{x,y) /2 in absolute value. Hence the integral Ji/^ is at 
most 

with some 71 > 0. For r < Xj^fa we have ar^ < 1 and hence e"'^^'^^-' = 1 + Q!0(r^). 
Consequently, the integral /g^^^ is equal to 

io ' 



e"^^"^(l + 0(T))(ir 



-aTip{x,y) 



(1 + 0(r) +Q0(r2)) dr. 



(18) 



Since, for A; = 0, 1, 2, 

with 72 > and 

it follows that (QHl) is 



a 



k+l / ' 



-aTip{x,y) 



-aT(p(x,y) 



-QV7(x,y) 

1 



(1 + 0(r) + aO(r2)) dr + O (e 



+ 
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In summary, 

uniformly for \y\ < e. Expanding near x = y = we obtain 

y) = - (1 - x2)°(l - + o(^) + o(y)) + O f ^) , (19) 

again uniformly. This was derived for |y| < e, but because of (fT7|) we see that this holds 
uniformly for all x and y satisfying a; + y > 0. This last condition can also be dropped by the 
symmetry of Ha{x,y). 

The asymptotics of the norm. If an integral operator K is of the form 

{Ku){x) = J ^ f{x)g{y)u{y)dy, 

then II i<r 1 1 = ||/||2||fi'||2, where II • II2 is the norm in L^(— 1, 1). Let us denote the integral operator 
with the kernel Ha{x,y) by Mq,. Furthermore, in view of (dl) we denote by M°, M^, the 
integral operators with the kernels 

(l-x2)"(l-y2)"^ 0(2;)(l-x2)"(l-y2)", 0(y) (1 - - y^)"^ 

respectively. From (|19() we infer that 

||M„|| = -\\M^ + M^ + M^\\+o(i.) . 
a \C( / 

Since 




and a similar estimate is valid for ||M^|p, we finally get 



which is the same as @. 

The lower bound. To prove the lower bound in ()1U() . we start with and the inequality 

{t-x){t-y) 



< {l-x){l-y), 



which was established in the course of the above proof. If x + y > 0, then max(x, y) > and 
consequently, 



Ho.{x,y) < {l + xni + yr |\l-xr-\l-yr-' — 



dt 



((l + i)/2)2 



Hence 



and thus 



= 2(l+x)(l-x2)°-l(l+y)(l-2/2)"-l. 

|M„|| < 2 /\l + xfil - x^r-'dx = 4^" ^'"i'^'" -f^- 
J-i (4a — Ij! 



\KU < 1 _L 42" (2a)!(2a - 2)! 



[(a - 1)!]2 42" (4a - 1) 



a2 (2a)!(2a)!(4a - 1) 



a!a! (2a - l)(2a)(4a)! 
which is equivalent to the assertion. 

The upper bound. The proof of the upper bound in is based on the observation that 
1/cq is the best constant for which the inequality 



1 1 /■! 

\u{x)\'^dx < — / |n(")(x)|2dx 



Ca Jo 



is true for all u £ C"^[0, 1] satisfying u^^\0) = u^^\l) = for < j < a — 1. If we insert 
u{x) = x"{l — x)", the inequality becomes 



^^"(1 - x)2°(ix < — r 

Ca Jo 



dx' 



(x"(l-x)") 



dx. 



The integral on the left is [(2a)!]^/(4a + 1)!, and in the integral on the right we make the 
substitution x = (l + y)/2to get 



dx" 



(x"(l-x)") 



dx 



4" J-i [dy'^ ) 



dy 
2 ■ 



The function {d" /dy"){y'^ - 1)" is 2° a! times the usual Legendre polynomial Pa{y) and it is 
well known that ||Po||2 = 2/(2a + 1) (see, for example, jTj). Consequently, the integral on the 
right is 

4" 2 ^ ^ 2a + 1 2a + 1 
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In summary, 

[(2«)!]2 ^ 1 {air 



< 



(4a + 1)! - c„ 2a + l' 
which is the asserted inequaUty. 

Refinements. By carrying out the approximations further we could refine (|17|) to the form 

where each Pij{x,y) is a homogeneous polynomial of degree j. The operator with kernel 
(1 — — y'^)"pij{x,y) has norm of the order a~^^~^^^^'^, so we get further approximations 

to Ha in this way, whence further approximations to the norm. (We do this by using the fact 
that the nonzero eigenvalues of a finite-rank kernel fii^) 9i{y) ^-^'s the same as those of the 
mxm matrix whose i,j entry is the inner product (/j, gj). One can see from this in particular 
that, because of evenness and oddness, with each approximation the power of a goes down by 
one.) However, these would probably not be of great interest. 



4 Another approach to Wirtinger-Sobolev inequahties 

We now show how Wirtinger-Sobolev integral inequalities can be derived from their discrete 
analogues, which, in dependence on the boundary conditions, are inequalities for circulant or 
Toeplitz matrices. In the Toeplitz case, we get in this way a new proof of the fact that the 
constants in the first and fourth problems are the same. 

Discrete versions of Wirtinger-Sobolev type inequalities were first established by Fan, 
Taussky, and Todd and the subject has been developed further since then (see, for ex- 
ample, jni and the references therein). In particular, for circulant matrices the following is 
not terribly new, but it fits very well with the topic of this paper and perfectly illustrates the 
difference between the circulant and Toeplitz cases. 

Circulant matrices. For a Laurent polynomial a(t) = J2k=-r^ki^ ^ ^^'^ n > 2r + 1, 
let Cn{a) be the n x n circulant matrix whose first row is 

(ao, a_i, . . . , a-r, 0, . . . , 0, ar,ar-i, . . . , ai). 

Thus, C„(a) results from the Toeplitz matrix Tn{a) by periodization. The singular values of 
Cn{a) are |a(a;^)| (j = 1, . . . ,n), where oJn = e^'^*/". 

Now let a{t) = (1 — t)" (t G T). One of the singular values of Cn{a) is zero, which causes 
a slight complication. It is easily seen that Ker C„(a) = span{(l, 1, . . . , 1)}. With notation as 
in Sectional / — PKcrCn(a) — Ct{^)^n{o) and hence 

\W - ^KerC„(a)^ll2 < l|C+(a)|| \\Cn{a)u\\2 (20) 
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for all u in C" with the £^ norm. The inverse of the (spectral) norm of the Moore-Penrose 
inverse C^{a) is the smallest nonzero singular value of C„(a) and consequently, 



\l-iOr, 



\\C^ia)\\ 

The projection -PKerC„(a) acts by the rule 



4 sin^ 



vr 



n 



a/2 



(21) 



(22) 



Inserting (dU and (EU in (Unj we get 

\\Cn{a)u\\l > f4sin2-) ^ 



a n 



Ui 



1 " 



4 sin^ 



TT 



i=l 
a I n 



E 



n ^ ^ 



n 



E 



(23) 



This is called a (higher-order) discrete Wirtinger-Sobolev inequality and was by different meth- 
ods established in 1^]. 

Periodic boundary conditions. As already said, the wanted inequality (|24() follows almost 
immediately from Parseval's identity. So the following might seem unduly complicated. How- 
ever, the analogue of (|24|) for zero boundary conditions is not straightforward from Parseval's 
identity, whereas just the following also works in that case. 

Let M be a 1-periodic function in C°°(R). We apply (|23|) to u„ = {u{j /n))^^-^^. The jth 
component of Cn{o)un is 



u 



J + 1 



n 



+ ... + {-iTu 



j + a 



n 



u 



(a) 



a+l 



n 



the O being independent of j. It follows that 



\Cn{a)u\\l = I E 



u 



n 



n 



n 



2a 



Consequently, multiplying (|23jl by n^" -"^ and passing to the limit n ^ oo we arrive at the 
inequality 



|u(°)(x)|2dx > (27r)2" ( / |u(x)pdx 



u{x)dx 



(24) 



Assume finally that u G C°[0, 1] and u(j)(0) = u^^\l) for < j < a - 1. We have 



^^(2;) = Er=-oo e'"*'" with 



u{x)e 



-2-nikx 



dx. 
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We integrate the last equality a times partially and use the boundary conditions to obtain 
that 

, , 1 



\Uk\ 



{2'K\k\Y 

Since u^'^^ G -^^^(0, 1), we see that = 0(l/|/c|") with Y^=-cx, ^fc < oo. This implies that 

oo 

^ |A;|2"|nfc|2 < oo. (25) 

A;=— oo 

We know that pi]) is true with u{x) replaced by {S^u){x) = Yl!k=-N '^k^^^^^ ^ 







|(57vw)(")(x)|2dx > (27r)2" / \{SNu){x)fdx 



{Sfqu){x)dx 



(26) 



From (|25|) we infer that 

nl 







(")(x)|2dx- / |(5^n)(")(x)|2dx= ^ |A;|2"|^,,|2 = o(l), 
° |fc|>Ar 



/V(^)l^f^^- /^(5ivn)(2;)|2(ix = y 
h Jo 1 ,7"^, 



ItifcP = o(l) 



|fc|>Af 

and since {Sj\[u){x)dx = Jq u{x)dx = uq, passage to the limit ^ oo in (|26|) yields ((S 
under the above assumptions on u. 

Toeplitz matrices. Again let a{t) = (1 — t)" (t G T), but consider now the Toeplitz ma- 
trix Tn{a) instead the circulant matrix Cn{a). It can be easily verified or deduced from [HI 
formula (2.13)] or [HI formula (1.4)] that 

r„*(a)T„(a) =r„(6)-i?„ 

where h{t) = |1 — tp" and Ra is a matrix of the form 



Sa 

On- 



with an a X Q matrix Sa independent of n. Consequently, 

||r„(a)ti||2 = {Tn{a)u,Tn{a)u) = {Tn{h)u,u) - {RaU,u). 

It follows that 

||T„(a)n||2 > Xmm{Tn{b)) \\u\\l - {RaU,u) (27) 
for all u S C". This is the Toeplitz analogue of (|23)1 . 

Zero boundary conditions. Let u E C°°(R) be a function which vanishes identically outside 
(0,1). As in the circulant case, we replace the u in ([TTj) by n„ = {u{j /n))^^^, multiply the 
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result by ^ and pass to the limit n oo. Taking into account that Xmm{Tn{b)) ~ Ca/n'^"', 
we obtain ^ ^ 

/ |n(")(x)|2dx > c„ / - lim n2"^^(ii^u„,u„). (28) 

By assumption, u and all its derivatives vanish at 0. This implies that 

for each fixed j. Since {RaUn,Un) is a bilinear form of u{l/n), . . . ,u{a/n), we arrive at the 
conclusion that {RaUn,Un) = 0(l/n^"). Hence, (PH|) is actually the desired inequality 

|n(")(x)p(ix > c„ \u{x)\'^dx. (29) 

JO JO 

The approximation argument employed in the case of periodic boundary conditions is also 
applicable in the case at hand and allows us to relax the assumption. It results that (|29|) 
is valid for every u G C"[0, 1] satisfying u^j\0) = u^^\l) = for < j < a — 1. 
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